SOLID STATE IMAGE PICKUP DEVICE AND ITS CONTROL METHOD 

This application is based on Japanese Patent Application HEI 
1 1-161247, filed on June 8, 1999, the entire contents of which are incorporated herein 
by reference. 



BACKGROUND OF THE INVENTION 

a) Field of the Invention 

The present invention relates to a solid state image pickup device 
)M1 0 having photoelectric conversion elements and its control method, and more 
^ particularly to techniques for controlling charge accumulation times of photoelectric 
^ . conversion elements. 
~ b) Description of the Related Art 

m Exposure times (charge accumulation times) of red (R), green. (G) and 

ffl 1 5 blue (B) pixels of a conventional color solid state image pickup device are controlled 
O uniformly. If an image is picked up under external light having a shifted color 

temperature, a color balance of the picked-up image becomes poor. For example, if 
a scene having a high color temperature, i.e., a bluish scene, is taken, although a 
sufficient signal for B pixels can be obtained, signals for G and R pixels are small. 
20 When color image signals having a good white balance are to be obtained from such 
signals, the dynamic range of the color image is determined basing upon the color 
signal having the smallest amplitude, in this case, R signal. A reproduced image has 
a poor color balance in a bright image area, being insufficient for R color and rather 
having a magenta hue. A reddish scene such as an evening scene has a tendency 
25 opposite to that described above. 
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SUMMARY OF THE INVENTION 

It is an object of the present invention to provide a solid state image 
pickup device and its control method capable of obtaining an image having a good 
white balance and an image with good color reproductivity, by controlling the 
5 charge accumulation times of photoelectric conversion elements independently for 
each color. 

According to one aspect of the present invention, there is provided a 
control method for a solid state image pickup device having a plurality type of 
^ photoelectric conversion elements for converting light of each of a plurality of colors 
JB 1 0 into electric charges, charge read-out region disposed, a mechanical shutter for 
^ opening and closing a path of incident light to the plurality type of photoelectric 

ril 

Li conversion elements, and an electronic shutter for clearing electric charges in each of 

i y 

~ the plurality type of photoelectric conversion elements, the control method comprising: 
gR a preliminary trial image pickup step of making the plurality type of 

fti 1 5 photoelectric conversion elements generate and accumulate electric charges during a 
Q predetermined charge accumulation time and detecting a charge amount 

corresponding to an intensity of light of each color; a calculation step of calculating a 
charge accumulation time of photosensitive conversion elements independently for 
each color so as to obtain a good white balance, in accordance with the charge 
20 amount corresponding to the intensity of light of each color detected by the 

preliminary trial image pickup step; and a final image pickup step of controlling the 
charge accumulation time of photosensitive conversion elements independently for 
each color by using the electronic shutter, the mechanical shutter, and read-out of 
electric charges from the photoelectric conversion elements to the charge transfer 
25 paths read-out region, in accordance with the calculated charge accumulation times, 
and making the plurality type of photoelectric conversion elements generate and 
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accumulate electric charges. 

According to another aspect of the present invention, there is provided a 
solid state image pickup device comprising: a plurality type of photoelectric 
conversion elements for converting light of each of red, green and blue colors into 
5 electric charges, the photoelectric conversion elements being disposed in vertical and 
horizontal directions in a two-dimensional plane; vertical charge transfer paths for 
transferring electric charges in the vertical direction; read gates for reading electric 
charges from the photoelectric conversion elements to the vertical charge transfer 
_ paths; a horizontal charge transfer path for transferring electric charges transferred 

1 0 from the vertical charge transfer paths in the horizontal direction; an electronic 
^ shutter for clearing electric charges in the plurality type of photoelectric conversion 
si elements; preliminary trial image pickup means for making the plurality type of 
~ photoelectric conversion elements generate and accumulate electric charges during a 
£R predetermined charge accumulation time and detecting a charge amount 
gi 1 5 corresponding to an intensity of light of each color; calculation mean for 
0 calculating a charge accumulation time of photoelectric conversion elements 

independently for each color so as to obtain a good white balance, in accordance with 
the charge amount corresponding to the intensity of light of each color detected by the 
preliminary trial image pickup means; and final image pickup means for 
20 controlling the charge accumulation time of photoelectric conversion elements 

independently for each color by using the electronic shutter, the mechanical shutter, 
and read-out of electric charges from the photoelectric conversion elements to the 
vertical charge transfer paths, in accordance with the calculated charge accumulation 
times, and making the plurality type of photoelectric conversion elements generate 
25 and accumulate electric charges. 

At the first preliminary trial image pickup stage, the charge accumulation 
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time of photoelectric conversion elements for each color is determined so as to obtain 
a good white balance. In accordance with each charge accumulation time, the 
charge accumulation times of the photoelectric conversion elements for respective 
colors are determined to perform a final image pickup operation. 

At the first image pickup stage, the charge accumulation time of 
photoelectric conversion elements for each color is determined so as to obtain a good 
white balance. In accordance with each charge accumulation time, the charge, 
accumulation times of the photoelectric conversion elements for respective colors are 
determined to perform a final image pickup operation. Accordingly, color image 
signals having a good color reproductivity can be obtained. Since the mechanical 
shutter and an electronic shutter are used, an image having a wide dynamic range 
can be obtained. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a timing chart illustrating an operation of a solid state image 
pickup device according to an embodiment of the invention. 

Fig. 2 is a graph showing a photodiode output relative to a charge 
accumulation time of each color pixel. 

Fig. 3 is a timing chart illustrating an operation of a solid state image 
pickup device according to another embodiment of the invention. 

Fig. 4 is a cross sectional view of a semiconductor substrate having a 
drain for draining electric charges from a vertical charge transfer path to the external. 

Fig. 5A is a plan view of a solid state image pickup device, and Fig. 5B 
is a schematic cross sectional view of an electronic still camera. 

Fig. 6 is a plan view showing an example of transfer electrodes for 
reading charges independently for odd and even columns. 




DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 



Fig. 5A is a plan view of a color solid state image pickup device 



according to an embodiment of the invention. The solid image pickup device is 
5 formed on a semiconductor substrate 1 made of silicon or the. like. The 

semiconductor substrate 1 has a plurality of photodiodes (photoelectric conversion 
elements) 2, vertical charge transfer paths (VCCD) 3, transfer gates (read gates) 4, a 
horizontal charge transfer path (HCCD) 6, an output amplifier 7, drains 10, and a 
control unit 8, respectively formed on the surface of the semiconductor substrate 1 as 



-5 10 one semiconductor chip. The control unit 8 may be formed on a different chip. 
W The photodiodes are disposed in a two-dimensional matrix shape, 

jj; Each photodiode converts received light into electric charge and stores the charge. 

^ Color filters are disposed on a light reception area of the photodiodes. R represents 

^ a photodiode (pixel) with a red filter, G represents a pixel with a green filter, and B 



J 1 5 represents a pixel with a blue filter. The layout of color pixels shown in Fig. 5A is 
Fj called a primary color Bayer matrix. In order to make it easy to understand, only 24 
pixels are drawn in Fig. 5A. The embodiment is not limited only to 24 pixels, and an 
actual solid state image pickup device has pixels far more than 24 pixels. 



20 external light is incident upon all photodiodes 2. As the mechanical shutter MS is 
closed, the photodiodes 2 are shielded from the external light. The exposure time 
(charge accumulation time) of each photodiode 2 starts when the mechanical shutter 
MS is opened, and ends when it is closed. 



25 A lens L mounted on the front of the camera receives external light which forms an 
image on a semiconductor chip 1 or CCD image pickup device via a mechanical 



As a mechanical shutter MS disposed above the substrate 1 is opened, 



Fig. 5B is a schematic cross sectional view of an electronic still camera. 
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shutter MS. The mechanical shutter MS is controlled by a shutter button SB. 

The control unit 8 can drain electric charges in each photodiode 2 to the 
substrate (collector region) 1 by applying an electronic shutter signal to the substrate. 
The exposure time of each photodiode 2 can start also by using the electronic shutter 
5 signal. 

Each vertical charge transfer path 3 is formed on the left side of each 
column of photodiodes 2 via transfer gates 4. The transfer gate 4 reads electric 
charges in the corresponding photodiode 2 to the vertical charge transfer path 3. 
_ Electric charges can be read independently for each of three colors RGB. For 
^0 1 0 example, transfer gates 4 can be controlled independently for odd and even columns 
~-f of each row. 

Fig. 6 shows an example of transfer gates capable of reading electric 
^ charges independently for odd and even columns. Photodiodes 2 disposed in a 
m matrix shape and vertical charge transfer paths 3 formed adjacent to each photodiode 
m 15 column are similar to those shown in Fig. 5A. 

(B Electrodes P2A and P1 A sandwich one row of photodiodes and 

constitute adjacent transfer stages on the vertical charge transfer path 3. Electrodes 
P2B and P1 B operate in a manner similar to the electrodes P2A and P1 A. The 
electrodes P1A and P1B are made of a first polysilicon layer, and the electrodes P2A 
20 and P2B are made of a second polysilicon layer. 

Each electrode has long transfer electrodes TE1 and short transfer 
electrodes TE2 alternately disposed along the row direction on the respective vertical 
charge transfer paths 3. Along each vertical charge transfer path, two long transfer 
electrodes and two short transfer electrodes are alternately disposed, like 
25 TE 1 -TE 1 -TE2-TE2-TE 1 -TE 1 . 

As a read voltage is applied to the electrode P2A, accumulated charges 
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are read from G pixels on every second column to corresponding vertical charge 
transfer paths. Similarly, as a read voltage is applied to the electrode P1 A, P2B, or 
P1 B, accumulated charges are read from every second column R, G or B pixels. In 
summary, the relation between the electrodes and read pixels is given by: 
5 . P2A, P2B: G 

P1A : R 

P1B :B 

As a read voltage is applied to the electrode P2A or P2B, one set of G 
electric charges per four transfer electrodes is read to corresponding vertical charge 
%0 1 0 transfer paths 3. As a read voltage is applied to the electrode P1 A or P1 B, one set 
83 of R or B electric charges per four transfer electrodes is read to corresponding vertical 
charge transfer paths 3. Read electric charges are transferred in vertical direction in 
^ the respective vertical charge transfer paths by applying four-phase drive signals V1 , 
5 V2, V3 and V4 to the electrodes P2A, P1 A, P2B and P1 B. 
S 15 The vertical charge transfer paths 3 are made of charge coupled 

5 devices (CCDs) and transfer electric charges read from the photodiodes 2 from the 
upper area of the drawing of Fig. 5A to the lower area (in a vertical direction). The 
horizontal charge transfer path 6 is made of a CCD, receives electric charges of one 
row unit transferred from the vertical charge transfer paths 3 and transfers the 
20 charges from the left area of the drawing of Fig. 5A to the right area (in a horizontal 
direction). 

An output amplifier 7 outputs a voltage corresponding to the amount of 
electric charges transferred from the horizontal charge transfer path 6. This voltage 
value corresponds to a pixel value. Each photodiode 2 corresponds to a pixel. By 
25 disposing the photodiodes two-dimensionally, signals of a two-dimensional image can 
be obtained. 
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The control unit 8 controls the transfer gates 4 to read electric charges 
from photodiodes 2 to the vertical charge transfer paths 3, controls the vertical charge 
transfer paths 3 and horizontal charge transfer path 6, and/or controls to clear electric 
charges in each photodiode 2. 

Unnecessary electric charges on each vertical charge transfer path 3 
can be transferred from the lower area to the upper area and drained to a drain 10 
formed at the upper end of the vertical charge transfer path 3. 

As a user half-depresses the shutter button SB, the solid state image 
pickup device performs a tentative image pickup. The output amplifier 7 outputs 
RGB signals obtained by the tentative image pickup. By using the RGB signals, a 
calculation unit 9 performs calculations of white balance, automatic exposure and the 
like. In accordance with the calculation results, exposure times are determined. 
More specifically, the exposure time is determined independently for each of R, G and 
B pixels. As the user full-depresses the shutter button SB, a final image pickup is 
performed by using the determined exposure times. The details of the tentative and 
final image pickup operations will be described. 

Fig. 1 is a timing chart illustrating the image pickup operation of a solid 
state image pickup device according to an embodiment of the invention. 

As a preliminary trial image pickup (tentative image pickup) stage, the 
mechanical shutter 1 1 is opened. Thereafter, an electronic shutter pulse is supplied 
at time ti to clear electric charges in all photodiodes 2. This electronic shutter pulse 
supplied at time ti initializes all the photodiodes 2 and starts the exposure time 
(charge accumulation time). At time t 2) a charge read pulse is applied to the transfer 
gates 4 corresponding to the photodiodes (pixels) 2 of all colors to read electric 
charges in the RGB photodiodes 2 to the vertical charge transfer paths 3. Each 
vertical charge transfer path 3 transfers the electric charges downward in the vertical 
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direction. The horizontal charge transfer path 6 receives the electric charges from 
the vertical charge transfer paths and transfers the electric charges right in the 
horizontal direction. The output amplifier 7 outputs RGB signals obtained by the 
tentative image pickup. 

Next, as a calculation stage, by using the RGB signals obtained by the 
tentative image pickup, the calculation unit 9 calculates the charge accumulation time 
independently for each of RGB pixels in order to obtain a good white balance of an 
image to be reproduced. This calculation method will be described with reference to 
Fig. 2. 

In Fig. 2, the abscissa represents a charge accumulation time (exposure 
time) and the ordinate represents a photodiode output (accumulated charge amount) 
corresponding to the intensity of light received by a photodiode. The tentative image 
pickup is performed at an exposure time of T S o(t2 - ti), and light intensities l RO) Icoand 
Ibo of RGB colors can be obtained by adding electric charges accumulated in the 
photodiodes of each color. 

Optimum charge accumulation times Tr, Tg and Tb of RGB colors can 
be calculated from the following equations: 

Tr = T S o x (Iso/Iro) x k 

Tg = T S o x (Iso/Igo) x k 

Tb = T S o x (Iso/Ibo) x k 

where Tr, Tg and Tb represent optimum charge accumulation times of 
red, green and blue pixels, l S o represents a saturated light intensity, and I Ro, Igo and 
Ibo represent detected light intensities (accumulated charges) of red, green and blue 
colors, and k represents an adequate gain. 

Next, the final image pickup is performed. At time t 3l an electronic 
shutter pulse is applied to the substrate 1 to clear electric charges of all the 



photodiodes 2. This electronic shutter pulse starts a first exposure time of. 
photodiodes. 

If the calculation results are Tr < Tg < Tb, at time t 4 after a lapse of 
about Tb - Tg, a B signal read pulse is supplied to the transfer gates 4 of the blue 
pixels. Conversely, if the calculation results are Tr > Tg > Tb, at time t 4 after a lapse 
of about Tr - Tg, an R signal read pulse is supplied to the transfer gates 4 of the red 
pixels. The former case corresponds to the timing chart shown in Fig. 1 . At time t 4) 
B signals are read to the vertical charge transfer paths 3. This read operation 
terminates the first exposure time Tb1 for B photodiodes. The first exposure time 
Tb1 is a time duration from time t3 to time t 4 . 

After the B signal is read, an electronic shutter pulse is supplied at time 
t 5 to reset or drain electric charges in all the photodiodes to the substrate 1 . This 
reset starts a second exposure time Tb2 of B pixels, an exposure time Tg for G pixels 
and an exposure time Tr for R pixels. 

After the lapse of the exposure time Tr from time t 5) an R pixel read 
pulse is supplied to read R signals from the R photodiodes 2 to the vertical charge 
transfer paths 3. This read operation terminates the exposure time Tr. 

Next, at time t 6 after the lapse of the exposure time Tg (=Tb2) after the 
reset timing t 5 , the mechanical shutter is closed to shield light incident upon the 
photodiodes 2. At time t 6) the exposure times Tg and Tb2 are terminated. The 
exposure times Tg and Tb2 are the time durations from time t 5 to time t 6 . 

The exposure time Tb for B pixels is a total of the first exposure time 
Tb1 and the second exposure time Tb2. The exposure time for G pixels is Tg and 
the exposure time for R pixels is Tr. 

At time te, the electric charges during the second exposure time Tb2 for 
B pixels remain in the photodiodes and the electric charges during the first exposure 
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time Tb1 for B pixels remain in the vertical charge transfer paths 3. The electric 
charges during the exposure time Tg for G pixels remain in the photodiodes 2. The 
electric charges during the exposure time Tr for R pixels remain in the vertical charge 
transfer paths 2. 

5 Next, a B pixel read pulse is supplied to read B signals from the 

photodiodes 2 to the vertical charge transfer paths 3. This read operation adds 
(mixes) the electric charges already stored in the vertical charge transfer paths 3 
during the first exposure time Tb1 to (with) the electric charges read to the vertical 
charge transfer paths 3 during the second exposure time Tb2. The electric charges 

CM 0 for R pixels during the exposure time Tr have already been read to the vertical charge 

W transfer paths 3. 

jjj Next, R and B electric charges (signals) on the vertical charge transfer 

^ paths 3 are transferred downward in the vertical direction in Fig. 5A. The horizontal 
charge transfer path 6 transfers the R and B signals received from the vertical charge 
S 1 5 transfer paths 3 in the horizontal direction. The output amplifier 7 outputs the electric 
fj charges as voltage signals to the external. 

Next, at time t 7 , a G pixel read pulse is supplied to read G signals from 
the photodiodes to the vertical charge transfer paths 3. Thereafter, the G signals on 
the vertical charge transfer paths 3 are transferred downward in the vertical direction 
20 in Fig. 5A. The horizontal charge transfer path 6 transfers the G signals received 
from the vertical charge transfer paths 3 in the horizontal direction. The output 
amplifier 7 outputs the G electric charges as voltage signals to the external. 

With the processes described above, the exposure times Tr, Tg and Tb 
for R, G and B signals can be controlled independently, and RGB pixel signals having 
25 a good white balance can be obtained. 

Next, an image pickup operation of a solid state image pickup device 
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according to another embodiment of the invention will be described with reference to 
the timing chart shown in Fig. 3. 

As the preliminary trial image pickup (tentative image pickup) stage, the 
mechanical shutter is opened. Thereafter, an electronic shutter pulse is supplied at 
5 time ti to reset all photodiodes 2. This reset starts accumulating the electric charges 
in the photodiodes of all pixels. At time t 2 , a charge read pulse is generated to read 
electric charges of RGB pixels from the photodiodes 2 to the vertical charge transfer 
paths 3. 

Next, as the calculation stage, by using the electric charges of RGB 
1 0 pixels obtained by the preliminary trial image pickup stage, the charge accumulation 
time is calculated for each group of RGB pixels in order to obtain a good white 
balance of an image to be reproduced. The above processes are same as the first 
embodiment. 

Next, the final image pickup stage is performed. It is assumed that the 
1 5 calculation results are Tr < Tg < Tb. First, at time t 3 an electronic shutter pulse is 
supplied to reset all photodiodes 2. This reset starts an exposure time for B pixels. 

Next, after a lapse of Tb - Tg from the time t 3t a G signal read pulse is 
supplied to read unnecessary G signals from the G pixel photodiodes 2 to the vertical 
charge transfer paths 3. This read operation resets the G pixel photodiodes 2 and 
20 starts an exposure time Tg. The unnecessary G pixel electric charges read to the 
vertical charge transfer paths 3 are transferred upward in the vertical direction shown 
in Fig. 5A and drained to the drains 10. 

After a lapse of Tb - Tr from time t 3( an R signal read pulse is supplied to 
read unnecessary R signals from the R pixel photodiodes 2 to the vertical charge 
25 transfer paths 3. This read operation resets the R pixel photodiodes 2 and starts an 
exposure time Tr: The unnecessary R pixel electric charges read to the vertical 
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charge transfer paths 3 are transferred upward in the vertical direction shown in Fig. 
5A and drained to the drains 1 0. 

Next, at time t 4 after the lapse of an exposure time Tb after time 
t 3) the mechanical shutter is closed. At time t 4l the exposure times Tb, Tg and Tr are 
terminated. After all the unnecessary G and R signals on the vertical charge transfer 
paths 3 are drained to the drains 10, B and R pixel read signals are supplied to read B 
and R signals from the photodiodes 2 to the vertical charge transfer paths 3. 

The vertical charge transfer paths 3 transfer the B and R signals 
downward in the vertical direction shown in Fig. 5A. The horizontal charge transfer 
path 6 transfers the B and R signals in the horizontal direction, and the output 
amplifier 7 outputs voltage signals corresponding to the B and R signals to the 
external. 

Next, a G pixel read pulse is supplied to read G signals from the 
photodiodes 2 to the vertical charge transfer paths 3. The vertical charge transfer 
paths 3 transfer the G signals downward in the vertical direction shown in Fig. 5A. 
The horizontal charge transfer path 6 transfers the G signals in the horizontal . 
direction, and the output amplifier 7 outputs voltage signals corresponding to the G 
signals to the external. 

With the processes described above, the exposure times Tr, Tg and Tb 
for R, G and B signals can be controlled independently, and RGB pixel signals having 
a good white balance can be obtained. 

In the first and second embodiments, it is assumed that the calculation 
results are Tb > Tg > Tr. The embodiments are also applicable to the calculation 
results of Tb < Tg < Tr. In this case, the control operations for B and R pixels are 
reversed. 

Fig. 4 is a cross sectional view taken along line IV-IV shown in Fig. 5A 
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and showing the drain 10. In a p-type semiconductor region 21 in an n-type Si 
substrate 20, an n-type semiconductor region (vertical charge transfer path) 3 and an 
n + -type semiconductor region (drain) 10 are formed. A positive potential Vdr is 
applied to the n + -type semiconductor region 10. A conductive film (polysilicon film) 
5 23 is formed on an insulating film 22 above the n-type semiconductor region 3. A 
gate voltage Vg is applied to the conductive film 23. As a positive potential is applied 
as the gate voltage Vg, electric charges on the vertical charge transfer path 3 are 
transferred and then drained to the drain 10 at the positive potential Vdr. 

A p + -type electrode region 25 is formed in the surface layer of the p-type 
CM 0 region 21 , and connected to a ground terminal GND. An n + -type electrode region 27 
00 is formed in the surface layer of the n-type substrate 20, and connected to an 
j~ overflow drain/electronic shutter terminal OFD. By applying a selected high voltage 
^ . to the terminal OFD, the potential barrier formed by the p-type region 21 under the 
S photodiode 2 (Fig. 1) can be extinguished and electric charges in the photodiode 2 
jS 1 5 can be drained to the substrate 20. 

g The present invention has been described in connection with the 

preferred embodiments. The invention is not limited only to the above embodiments. 

It will be for those skilled in the art apparent that various modifications, 
improvements, combinations, and the like can be made. 

20 
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